Skip to content

[WIP] LM Workload #860

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 46 commits into
base: dev
Choose a base branch
from
Draft

[WIP] LM Workload #860

wants to merge 46 commits into from

Conversation

rka97
Copy link
Contributor

@rka97 rka97 commented Apr 3, 2025

This is for the LM workload.

priyakasimbeg and others added 30 commits February 27, 2025 14:56
@priyakasimbeg
Merge pull request #847 from mlcommons/dev
1d81455 
Dev -> main
@Niccolo-Ajroldi
first LM commit
da5f85a
@Niccolo-Ajroldi
lm data pipeline
a12a364
@Niccolo-Ajroldi
testing
ca83ab8
@Niccolo-Ajroldi
LM workload tested torch pipeline
e3e78dc
@Niccolo-Ajroldi
LM workload - fix torch tests
e619495
@Niccolo-Ajroldi
add LM tests, remove dev files
d8e9c56
@Niccolo-Ajroldi
add LM tests, remove dev files
6b4ff12
@Niccolo-Ajroldi
Stop tracking .gitignore
3c5c847
@Niccolo-Ajroldi
Remove dev/ from repo, keep locally
20d841b
@Niccolo-Ajroldi
fix comments
f3ba059
@Niccolo-Ajroldi
add class specifications
381451f
@Niccolo-Ajroldi
add workload LM info
f111d2e
@Niccolo-Ajroldi
restore data_utils.py tree map
808d398
@Niccolo-Ajroldi
fixed NFS bug
35f8f89
@Niccolo-Ajroldi
train/val split before concat
cbb6ee6
@Niccolo-Ajroldi
renamed datasets to avoid conflict with HF
868987c
@Niccolo-Ajroldi
Merge remote-tracking branch 'upstream/lm_workload' into lm_workload
8191f6d
@Niccolo-Ajroldi
renamed datasets to dataset
dd59ded
@Niccolo-Ajroldi
fix style
496b9c3
@Niccolo-Ajroldi
fix formatting
50989eb
@Niccolo-Ajroldi
fix style
5af0fdc
@Niccolo-Ajroldi
fix style
2683099
@Niccolo-Ajroldi
fix yapf
6b7ee29
@Niccolo-Ajroldi
fix style
46b645b
@rka97
HF datasets pipeline
b3ae647
@rka97
Testing with linear model
f095d4b
@rka97
Merge branch 'jit_switch' into lm_workload
4189ae0
@rka97
lm workload with linear model
0c22f3d
@rka97
add nanodo model
99c7b9b
@github-actions GitHub Actions
Copy link

github-actions bot commented Apr 3, 2025 •
edited
Loading

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

@priyakasimbeg priyakasimbeg changed the base branch from main to dev October 2, 2025 00:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@priyakasimbeg priyakasimbeg

@rka97 rka97

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@rka97 @priyakasimbeg @Niccolo-Ajroldi